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GRAPHIC DIGITAL SIGNATURES 

BACKGROUND OF THE INVENTION 

With the increased usage of the Internet and other 
5 computer networks, it is becoming increasingly important to 
be able to ensure that an electronic message received over 
a network is both authentic, i.e., that the sender is who 
he claims to be, and that the message has not been altered 
by some third party en route. 

10 Digital signatures have been developed to fill this 

need. A digital signature is a digital representation of 
information identifying the author or source of a document 
which includes but is not limited to a demonstration of 
knowledge of secret or little-known information 

15 Generally, a sender, using a computer or similar 

digital means, composes a message he intends to send to one 
or more recipients. At the sender's request, or 
automatically, a digital signature is derived based on some 
aspect of the. message. How the digital signatures are 

2 0 actually coded and decoded are beyond the scope of this 
patent, but see Mitchell, Piper and Wild, "Digital 
Signatures", Contemporary Cryptology, pp. 325-378, which is 
incorporated herein by reference. 

Digital signatures are typically attached to digital 
25 messages which are passed from one computer to another via 
a network - from small, in-house intranets to the large 
networks such as the Internet. Current methods represent 
digital signatures as large blocks of alphanumeric, 
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hexadecimal or binary characters. For example, a digital 
signature might be represented in an electronic mail (e- 
mail) as follows: 

iQBFAgUBM0jm3ygmpqV0uJ6VAQFOqwF/emw7/FlwFFe3q00HlQZbt2JI5Y2 
5 Rl>>]gYovXpsOsUgNVAbqHMiyHD2uTDLVxdID7 6=THEF 

Representations such as this are not only 
aesthetically unpleasing to a human recipient but due to 
their highly technical appearance may serve to discourage 
non-technical users from using digital signature technology 
10 altogether. 

SUMMARY OF THE INVENTION 

Representing digital signatures in meaningful and 
intuitive graphical and audio forms allows non- technical 
users to easily understand their purpose. Such users are 
15 therefore more likely to use digital signatures. By 
providing a method for personalizing the display of a 
digital signature, all users are encouraged to use digital 
signatures in their own messages. 

2 0 The present invention provides means for 

steganographically embedding a digital signature into a 
more intuitive signature graphic such as is shown at 50 in 
Fig. 1 or into an audio recording of the sender saying 
something such as "This document about widget pricing dated 

25 May 23, 1997, has been written by me." 

In accordance with the present invention, a method of 
digital communication comprises the steps of providing a 
digital message that the sender desires to send to one or 
more recipients; providing a digital signature such as a 
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private key encrypted hash of the message or a biometrxc 
such as a private encryption key or unique biometric 
information such as a facial picture, a fingerprint, an 
iris or retinal scan, typing and handwriting patterns, hand 
or finger geometry or a voice print; providing a user- 
perceptible attachment such as a picture or audio; 
embedding the digital signature into the attachment; 
attaching the attachment to the message to form a digital 
communication; and sending the communication. 

in a preferred embodiment, the digital signature is 
embedded into the attachment by substituting bits of the 
digital signature into selected least significant bits of 
the attachment. In this manner, the changes to the 
attachment are virtually undetectable by the recipient. 
The existence or the state of the attachment itself may 
alert the recipient to the fact that a digital signature is 
present Furthermore,' a header may be embedded into the 
attachment at predetermined locations. This header may 
serve to identify the existence of the digital signature, 
or the header may contain parameters which provide further 
information about the digital signature, e.g., coding 
technique, location within the attachment, etc. 

The attachment may be modified before embedding the 
digital signature by any number and manner of 
transformations. Such modification may be used to alert 
the recipient that a digital signature is present. 
Examples of such modification transformations are warping 
and morphing . 

Either the recipient can initiate verification of the 
30 digital signature, or such verification can come about 
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automatically . Generally, when a communication is 
received, both the message and the attachment are available 
to the recipient. The recipient may begin the verification 
process, for example, by selecting the attachment using a 
5 computer mouse. Verification comprises extracting the 
digital signature from the attachment and verifying the 
validity of the digital signature according to standard 
digital signature techniques. Finally, the recipient may 
be no--^fied as to whether the digital signature is valid or 
10 not, or the digital signature may be displayed to the 

recipient. The software that forms those functions may, 
for example, be incorporated in otherwise conventional e- 
mail software. 

The above and other features of the invention 
15 including various novel details of construction and 

combinations of parts, and other advantages, will now be 
more particularly described with reference to the 
accompanying drawings and pointed out in the claims. It 
will be understood that the particular method and device 
20 embodying the invention are shown by way of illustration 
and not as a limitation of the invention. The principles 
and features of this invention may be employed in various 
and numerous embodiments without departing from the scope 
of the invention. 



25 BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, features and 
advantages of the invention will be apparent from the 
following more particular description of preferred 
embodiments and the drawings in which like reference 
characters refer to the same parts throughout the different 
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views The drawings are not necessarily to scale, emphasis 
instead being placed upon illustrating the principals of 

the invention. 

Fig. 1 illustrates a graphic signature as it might 

5 appear in an e-mail. 

Fig. 2A illustrates a prior art electronic e-maxl 
communication with an alphanumeric representation of a 

digital signature. 

Fig. 2B illustrates an electronic e-mail communication 
10 with a graphic in which a digital signature is 
steganographically embedded. 

Fig. 3 is a flowchart showing generally the process of 

embedding a digital signature. 

Fig 4 is a flowchart showing generally the process of 
extracting a digital signature and further processing it. 

Fig. 5 illustrates a graphic which could be used to 
notify a recipient of a valid digital signature. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig 2A illustrates an electronic mail (e-mail) 
communication 100 as it might appear in prior art. The 
sender has composed a message 102, in this example, 
consisting of the sentence "Please give Alice Gilbert a 
master key," followed by a salutation. A digital signature 
104 is generated. The digital signature may be based on 
the message 102 and a key known or provided to the sender- s 
computer, or it may be independent of the message 102 
itself as in the case where the signature is a 
fingerprint. The digital signature 104 is appended to the 
message 102, along with some additional information 106, to 
form the digital communication, which is transmitted or 
sent to one or more intended recipients. A non-technical 
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person receiving this message may not itnmediately know the 
purpose of the digital signature 104 and/or how to use it. 

Fig. 2B illustrates the equivalent email communication 
110 as produced by the present invention. A message 112 
consists of some text the sender wishes to convey to the 
recipient, again, in this example, the sentence "Please 
give Alice Gilbert a master key," followed by a salutatxon. 
in this example, however, a graphic, digitized (not 
digital) signature 114 of the sender (Sally) is attached to 
the communication. This graphic 114 has been slightly 
altered such that it contains the same digital signature as 
shown in 104 of Fig. 2A. 

When the signed email 110 of Fig. 2B arrives at its 
destination and is selected for reading by the recipient, 
the recipient is offered the opportunity to verify the 
signature. If the user decides to verify the signature, 
for example by selecting a "Verify" button, then the e-maxl 
software extracts the digital signature 104 from the 
graphic 114 and performs the usual digital signature 
verification. If the digital signature 114 is verxfxed, 
i e the digital signature supports the claim that the 
email comes from Sally Green, the software might display an 
acknowledgment such as "Signature verified as the signature 
of sally Green," or a graphic 60 such as that shown xn Fxg. 
25 5 . 
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Of course it would be understood in the art that the 
message may be text, audio, graphic, or some other mode of 
conveying information digitally. Furthermore, it would be 
understood that the communication is not limited to emaxl . 
For example, the communication could be a transmittal of a 
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World Wide Web page or some other means of digitally 
transmitting a message. Finally the attachment into which 
the digital signature is embedded may itself be text, 
audio, graphic, video, etc. 

5 The attachment may be modified before embedding the 

digital signature. For example, warping and morphing , as 
well as other transformations, may be applied to a graphic 
or picture. Similarly, other types of transformations may 
be applied to audio signals. Such modifications may be 
10 used to alert the recipient that a digital signature is 
present . 

Fig. 3 is a flowchart showing generally the process of 
embedding a digital signature. First, at 200, the sender 
composes or otherwise provides a message comprising the 

15 information he wishes to communicate to the recipients. At 
202 an image or audio attachment is provided, and at 204 a 
digital signature is calculated or otherwise provided. 
Examples of suitable digital signature algorithms can be 
found in "Digital Signature Schemes" by Birgit Pfitzmann 

20 and published by Springer-Verlag in 1996 (ISBN 3-540-61517- 
2) Which is herein incorporated by reference. 

The attachment can be modified using image processing 
or audio processing algorithms. The purpose of this 
transformation is to provide to the recipient an indicator 
2 5 that a digital signature has been included and can be 

validated. For example, an image may undergo warping 206, 
morphing 208, and/or other transformations 210. Audio be 
may subjected to audio- type transforms, for example, 
filtering . 
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Warping 206 is typically applied to line-drawing 
images and comprises bending or moving some of the lines in 
the image. For example, if the original attachment is an 
image of a dragonfly and the body of the dragonfly is a 
5 long, curved cigar shape, this image can be warped by 
increasing or decreasing the bending of the body of the 
dragonfly. In one embodiment of the present invention, the 
amount of warping is determined based on parameters 
computed from the document such as a word count. 

10 Morphing algorithms 208 transform one image to another 

by computing a series of images visually between a 
beginning image and an ending image. In one embodiment of 
the present invention, a user chooses an ending image to 
morph an original "signing" image toward. If some computed 

15 value for the message, such as a word count or a digital 

.signature, is n on a scale .from 0 to N, then the image that 
is n/N of the way from the original signing image to the 
ending image is selected as the attachment in which the 
digital signature will be embedded. Examples of suitable 

2 0 warping and morphing algorithms can be found in "Digital 

Image Warping" by George Wolberg and published by the IEEE 
Computer Society Press in 1990 (ISBN 0-81868944-7) which is 
herein incorporated by reference. 

Referring again to Fig. 3 after the transformations 
25 206, 208, 210 have been applied to the attachment, the 
digital signature is embedded into the attachment using 
steganographic techniques 212, described below. The 
attachment is attached 214 to the message to form a 
communication, and finally, the communication is 
30 transmitted 216 to the intended recipients. 
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Steganographic algorithms are typically used to hide 
information in images, although the technique is easily 
applied to digital audio signals as well . What appears to 
be an innocent picture actually contains a secret message. 
The embedding of the text into the picture is deliberately 
constructed so as to not disturb the image such that a 
viewer cannot tell that the picture contains a message 
simply by looking at it. In other words, the embedding 
does not alter - at least to the human eye or ear - the 
appearance of the picture or the sound of an audio. 
Suppose for example that a black and white photograph 
exists such that each point (pixel) in the photograph is 
represented as a 16-bit number where 0 represents all 
white, 32,768 represents all black and numbers in between 
15 represent shades of gray between white and black. Taking a 
digital signature as a string of bits, the digital 
signature can be embedded into the photograph by setting 
the low- order bit of a pixel (a point in the photograph) of 
the photograph to 0 when the corresponding bit in the 
20 digital signature is 0, and to 1 when the corresponding bit 
in the digital signature is 1 . If the low-order bit in tfhe 
pixel were originally 0 and it is now set to 1, then the 
pixel becomes just a little darker, but not enough to be 
noticeable. Similarly, if the low-order bit in the pixel 
25 were originally 1 and it is now set to 0, then the pixel 

becomes just a little brighter, but again not enough to be 
noticed. Continuing in this fashion, all of the bits of 
the digital signature can be embedded into the photograph 
without visually changing it. Examples of suitable 
steganographic algorithms can be found in "Information 
Hiding: Proceedings of the First International Workshop, 
U.K. May 30 - June 1, 1996" edited by Ross Andersion and 
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published by Springer-Verlag in 1996 (ISBN 3-540-61996-8) 
which is herein incorporated by reference. 

In the present invention, it is not the intention to 
actually hide the digital signature from a recipient, that 
5 is prevent a recipient from accessing the embedded digital 
signature, but rather to use the attachment to "carry" the 
digital signature in such manner that the attachment is not 
noticeably altered by the digital signature. 

Fig- 4 is a flowchart showing generally the process of 
10 extracting and processing the digital signature from the 
received communication. First, the communication must be 
received by the recipient or his computer 302. The 
.recipient must be made aware that the communication 
contains an embedded digital signature. This is done by 
15 displaying 3 04 the graphic attachment so that the recipient 
can see it, or, in the case of an audio attachment; playing 
the attachment so that the recipient hears it , Any 
transformations which have been applied may themselves be 
the clue to the recipient that a digital signature has been 
2 0 embedded. 

The recipient can then ask for validation of the 
digital signature 3 06 and the digital signature is 
extracted from the attachment 308 by reading the bits known 
to contain the digital signature. In a preferred 
25 embodiment, the digital signature is verified 310 and the 
recipient is notified 312 as to whether the signature is 
valid or not. Alternatively, the extracted digital 
signature can be displayed 314 for the recipient's viewir.g. 
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While this invention has been particularly shown and 
described with references to preferred embodiments thereof, 
it will be understood by those skilled in the art that 
various changes in form and detail may be made therein 
5 without departing from the spirit and scope of the 
invention as defined by the appended claims. 
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CLAIMS 

1 . A method of digital communication comprising: 
providing a digital message; 

generating a digital signature related to the 
message ; and 

embedding the digital signature in a user- 
perceptible attachment accompanying the digital 
message. 

2 . A method as in Claim 1 wherein embedding the digital 

signature comprises the steps of : 

selecting bits within the attachment ; 
associating bits of the digital signature with 

the selected bits; and 

altering the selected bits by writing the digital 

signature bits into the associated attachment bits . 

3 . A method as in Claim 2 wherein a known header string 

is inserted at a predetermined location in the 
attachment . 

4. A method as in Claim 3 wherein the header string 
comprises parameters describing the digital signature . 

5. A method as in Claim 1 further comprising the step of 
modifying the attachment before the step of embedding 
the digital signature . 

6. A method as in Claim 1 wherein the attachment is a 
digital picture , 
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7 . A method as in Claim 6 wherein the digital picture is 
a representation of an entity whose identity is being 
embedded in the picture. 

8 . A method as in Claim 6 further comprising the step of 
5 modifying the digital picture before the step of 

embedding the digital signature . 

9 . A method as in Claim 8 wherein the step of modifying 
the digital picture comprises warping the digital 
picture according to a computed value . 

10 10. A method as in Claim 9 wherein the computed value is 
the digital signature . 

11. A method as in Claim 8 wherein the step of modifying 
the digital picture comprises morphing the digital 
picture according to a computed value. 

15 12. A method as in Claim 1 wherein the attachment is a 
digitized audio passage. 

13 . A method as in Claim 12 further comprising the step of 
modifying the audio passage in accordance with a 
computed value, before the step of embedding the 

20 digital signature. 

14. A method as in Claim 12 wherein the audio passage is a 
voice recording of an entity whose identity is being 
embedded in the audio passage. 

15. A method as in Claim 1 wherein the digital signature 
25 is generated from a private encryption key. 
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16. A method as in Claim 1 wherein the digital signature 
is a digitized biometric . 

17. A method as in Claim 16 wherein the digitized 
biometric is a digital fingerprint. 

18. A method as in Claim 16 wherein the digitized 
biometric is a digital voiceprint 

19- A method as in Claim 16 wherein the digitized 
biometric is a digital retina scan. 

20. A method as in Claim 1 further comprising: 

including the attachment with the embedded 
digital signature in a digital communication; 

transmitting the digital communication to a 
recipient ; 

receiving the digital communication at the 
recipient ; 

extracting the digital signature from the. 
attachment within the received digital communication; 
and 

processing the extracted digital signature. 

21. A method as in Claim 20 wherein the step of processing 
the extracted digital signature comprises: 

verifying validity of the digital signature; and 
notifying the recipient as to whether the digital 
signature is valid or not. 

22. A method as in Claim 21 further comprising before the 
step of verifying validity: 
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providing a means wherein the recipient is made 
aware of the existence of the digital signature; and 

providing a means wherein the recipient can 
indicate that the digital signature should be 
validated, at which time the verifying and notifying 
steps take place. 

23. A method as in Claim 21 wherein the step of processing 
the extracted digital signature comprises: 

displaying the digital signature to the 

recipient. 

24. A computer system for sending a digital communication 
comprising : 

means for providing a digital messages- 
means for generating a digital signature related' 
to the messages- 
means for embedding the digital signature in a 
user-perceptible attachment ; 

means for attaching the attachment to the message 
to form the digital communication; and 
0 means for sending the communication to a 

recipient . 

25. A computer system for verifying authenticity of a 
received digital communication comprising: 

means for receiving the digital communication 
5 comprising a digital message and a user-perceptible 

attachment ; 

means for extracting the digital signature from 
the attachment; and 

means for processing the digital signature. 
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26, A computer system as in Claim 25 wherein the means for 
processing the digital signature further comprises : 

means for verifying validity of the digital 
signature ; and 

means for notifying a recipient as to whether the 
digital signature is valid or not. 

27. A computer system as in Claim 25 wherein the means for 
processing the digital signature further comprises : 

means for displaying the digital signature to the 
recipient . 
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FIG. 1 
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BEGIN PGP SIGNED MESSAGE — 106 



Piease give Alice Gilbert a master key. 
Thanks, Sally 




—BEGIN PGP SIGNATURE— 
Version: 4.5 



} 



106 



iQBFAglJBMOjm3ygmpqVOuJ6VAQFOqwF/eniw7/FlwFFd3qOOHlQ 
Xbtzn5Y2RKMgYovXpsOsUgNVAbqHMiyHD2uTDLVxdID76 ^ 104 

=THEF 

END PGP SIGNATURE io6 



} 



100 y 



FIG. 2A 

(prior art) 



Please give Alice Gilbert a master key. 

" 112 



} 



Thanks, 

114 



110 

FIG. 2B 
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FIG. 4 
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FIG. 5 
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